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Abstract 


This research examines whether sentiments conveyed in the State Bank of Pakistan’s (SBP) 
communications impact financial market expectations and can act as a monetary policy tool. 
To achieve our goal, we first use sentiment analysis techniques to quantify the tone of SBP 
monetary policy documents and second, we use short time window, high frequency methodol- 
ogy to approximate the impact of tone on stock market returns. Our results show that positive 
(negative) change in the tone positively (negatively) impacts stock returns in Karachi Stock 
Exchange. Further extension shows that the communication of SBP still has a statistically 
significant impact on stock returns when controlling for different variables and monetary pol- 
icy tool. Also, the communication of SBP does not have a long term constant effect on stock 
market. 
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1 Introduction 


The Pakistani stock market plays a crucial role in the country’s economic development, and there 
is evidence suggesting a long-run relationship between the Pakistani stock market and economic 
growth Shahbaz et al. (2008). It serves as a barometer of investor confidence, facilitates capital 
formation, and drives industrial activity Tauseef and Dupuy (2022). However, understanding the 
factors influencing its performance remains a complex challenge. This research aims to delve into 
one such potentially influential factor: the sentiments conveyed in the State Bank of Pakistan’s 
(SBP) monetary policy documents. Central banks worldwide employ monetary policy pronounce- 
ments to guide economic expectations and influence market behavior. These pronouncements often 
utilize specific language styles and tones, potentially impacting investor sentiment and subsequent 
investment decisions Blinder et al. (2008). Despite this potential influence, the relationship be- 
tween central bank language and stock market performance remains under-researched, particularly 
in emerging markets like Pakistan. 

While existing studies have explored the impact of central bank communication on various factors 
of the economy, examined its influence on stock market movements. In the context of Pakistan, 
no prior research has investigated the link between Central Bank of Pakistan’s communication and 
stock market of Pakistan. This study aims to bridge this gap. 

This research proposes the following research question: How does the sentiments conveyed in the 
State Bank of Pakistan’s monetary policy documents affect the performance of the KSE - 100 index? 
H1: Increased optimism or confidence expressed in SBP communications positively impacts KSE - 
100 performance. 

H2: Aggressive or hawkish stances adopted in SBP pronouncements negatively affect KSE -1 00 
performance. 

This research employs a quantitative approach based on time-series data analysis. We utilize 
sentiment analysis techniques to extract sentiment indicators from SBP documents from 2016 to 
2024. These sentiment scores regresse against the KSE - 100 index returns, controlling for relevant 


macroeconomic and financial variables such as policy rate, economic uncertainty, and consumer 


confidence etc. Understanding the link between SBP language and stock market performance in 
Pakistan, can have significant implications for both policymakers and investors. For policymakers, it 
can provide valuable insights into crafting communication strategies that foster investor confidence 
and market stability. For investors, it can offer valuable predictive tools for navigating the market 
based on central bank pronouncements. 

In conclusion, this research promises to address a critical gap in our understanding of state bank 
communication and its impact on Pakistani stock market performance. By analyzing the relation- 
ship between SBP sentiment and KSE - 100 movement, we hope to contribute valuable insights to 
both academic and practical domains, thereby aiding in fostering sustainable growth and stability 


in the Pakistan financial system. 


2 Literature Review 


This literature review delves into the growing field of central bank communications, sentiment anal- 
ysis, and their impact on financial markets. By investigating diverse studies across geographical 
contexts and central banks, this review aims to establish a comprehensive understanding of how 
central bank pronouncements influence market behavior and contribute to financial stability. This 
literature suggests that the most direct effects of monetary policy, along with central bank commu- 
nications, are on the financial sector. To be more specific, Bennani (2019) stated that changes in 
monetary policy are transmitted through the stock market via changes in the values of private port- 
folios or changes in the cost of capital. To explain this Bernanke and Kuttner (2005) estimated that 
25-basis-point cut in the federal funds rate target is linked with about a 1 percent increase in CRSP 
value-weighted index. They found that impacts of unexpected monetary policy actions on expected 
excess returns take for the largest part of the response of stock prices. De Haan (2008) explains that 
financial markets clearly respond to the effective communication of central banks. Gtirkaynak et al. 
(2005) also argues that asset prices respond to the Open Market Committee (FOMC) statements. 
They estimated that FOMC statements put their effects on financial market via their influence on 


market expectations. Ehrmann and Fratzscher (2007) and Reeves and Sawicki (2007) concluded 


the same for European Central Bank and the Bank of England respectively. 


However, the transparency and communication strategies have been increasing of the State Bank 
of Pakistan but little is known how these communication affects stock market of Pakistan Sohail 
et al. (2019), Zaheer et al. (2019), and Saad et al. (2019). The SBP releases statements and publish 
monetary policy documents along with annual financial reports about monetary policy and economic 
outlook. So, looking at the unobserved nature of various tools of monetary policy implemented by 
SBP, its announcements provides news which are expected to move the assets prices. Xiong (2012) 
computed an index of monetary policy based on People Bank of China documents. In order to 
estimate a monetary policy rule, the author codes People Bank of China (PBC) statements and 
uses this variable. He concludes that words aid deeds in understanding PBC monetary policy after 
finding that his rule performs better than one based solely on interest rates. But we should bear 
in mind that central banks have no full power in their objectives and instruments. As a result, the 
central bank’s ability to provide prior advice on when to make crucial monetary policy decisions is 


limited McMahon et al. (2018). 


Moreover, existing literature states that sentiments conveyed in the documents of central banks 
determines, how market agents develope and alter their expectations Angeletos and La’o (2013), 
Angeletos et al. (2018), and Benhabib et al. (2015). Hence, sentiments conveyed in the monetary 
policy documents and speeches of the central banks are considered to be valuable information 
Hubert and Fabien (2017). If we dive more deeply into the existing literature, we find that central 
bank communications have an impact on various aspects of the financial market. Born et al. (2014) 
concluded his paper that financial markets, arguably is one of the most important target groups 
of central bank communications. Their findings suggest that the communications about financial 
stability have significant outcome on stock prices. Wang et al. (2023) findings focus on dynamics of 
the economic aspects addressed in the communications of the Central Economic Work Conference 


(CEWC) of China and its connections to the stock market. 


Looking more closely at the literature, we find that central banks’ communications have a significant 
impact on financial stability. Istrefi et al. (2023) computed the indicators that measures the senti- 
ments of the speeches of governors of Fed and FRB presidents. According to their findings, a higher 
topic intensity or negative tone, applied to a typical forward-looking Taylor rule, is linked more to 
monetary policy accommodation than the economy’s current position suggests. In an illustration 
of this, Du et al. (2023) computed the emotional dictionary of China’s financial stability communi- 
cations, quantified the tone of central bank’s financial stability communications, and computed an 
index for it. The findings demonstrated that: (1) written communications, in the form of Financial 
Stability Reports, can successfully steer market trends in the direction anticipated by the central 
bank, while oral communications has no discernible impact; and (2) written communications can 
lessen stock market volatility, whereas oral communications can exacerbate stock market volatility. 
Similarly, Gertler and Horvath (2018) investigate the impacts of European Central Bank’s commu- 
nications on the financial market more specifically interest rate, exchange rate, and stock market 


using least squares and quantile regressions. 


Different textual analysis, natural language processing (NLP), and deep learning models have been 
used to quantify the tone of central banks’ communications. Such as Ruman (2023) used some 
methods from (NLP), content analysis, sentiment analysis, and discourse analysis to understand 
the decision making process of the Federal Open Market Committee (FOMC) and the factors 
that impact its monetary policy decisions especially during high inflation periods. Similarly, Apel 
and Grimaldi (2014) via automatic content analysis, which turns the qualitative information in 
the minutes of monetary policy meetings into a quantitative measure, gauged the sentiment and 
tone of the Swedish Central Bank minutes. They found that this measurement is very useful 
in forecasting the future policy rate decisions. To spot the fundamental topics of the central 
bank speeches, Bohl et al. (2023) used the STM methodology: an unsupervised machine learning 
model. They inspected factually how inflation and unemployment expectations impact the tone 
of the Federal Reserve System (FED) and the European Central Bank (ECB) relative to past 


macroeconomic developments. Moreover, Moniz and de Jong (2014) used textrank link analysis 


algorithm and multinomial Naive Bayesian model to predict the effects of Bank of England’s (BoG) 
Monetary Policy Committee Minutes on investors’ interest rate expectations. Petropoulos and 
Siakoulis (2021) adopted the analysis of NLP sentiment index using the XGBoost machine learning 
technique to identify useful statements in the corpus of central bank’s governors speeches and 
computed a sentiment index to predict future financial market behavior. Andersen and Thorshaug 
(2023) applied a multinomial inverse regression (MNIR) to create a positive and negative sentiment 
dictionary of the documents of the Norwegian Central Bank. Their thesis tried to investigate the 


connection between sentiments in central bank communication and stock market returns. 


3 Data 


3.1 Tone of SBP Communication 


As our paper aims to examine how the tone of the SBP communication influences stock prices, we 
require a communication tool with accurate timing. Therefore, we opt for SBP minutes of meeting 
since they are posted online on the official website of SBP, ensuring immediate accessibility for 
market participants. 

The primary challenge in assessing tone involves converting SBP documents into a quantifiable 
measure suitable for analysis. Initially, we gather documents from SBP officials website accessible 
online for everyone. The documents presented in real-time are exclusively in the English language, 
providing a significant advantage for our analysis since all textual analysis models are trained on 
English. We perform prepossessing on these documents and convert all the documents into .txt 
format. We eliminating superfluous elements such as stop words, full stops, commas, punctuation, 
hashtags, numbers, days, months, years and graphs, and convert all the text to lowercase. The 
python code for complete prepossessing is in the appendix. We compile a total of 56 documents 
that span January 2016 to January 2024. In particular, these documents published publicly (e.g., 


the official website of SBP) don’t have a regular delivery pattern, as depicted in Fig. 1 below. 


Figure 1: Number of Documents Per Year 
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In the next phase, we determine the tone of State Bank of Pakistan (SBP) communications by 
employing a bag-of-words method and utilizing the financial dictionary created by Loughran and 
McDonald (2011). This involves analyzing the content of SBP communications using a collection 
of words associated with financial sentiments from the specified dictionary. We utilize a dictionary 
method for tone quantification to circumvent potential drawbacks associated with using the data 
twice. Specifically, this approach avoids training an algorithm on the same data to which it is 
subsequently applied. Furthermore, as pointed out by Cambria et al. (2017) statistical text clas- 
sifiers yield meaningful results when provided with a sufficiently large text input Bennani (2019). 
To address this, we employ previous information as an LM dictionary to gauge the sentiments of 
monetary policy documents. This LM dictionary is specifically constructed for financial as well 
as economic documents, as explained by Gurun and Butler (2012) and Hillert et al. (2014). This 
dictionary has also been proven to be relevant in the context of central bank communication, as 
discussed by Hansen and McMahon (2016). Bennani (2019). Moreover, there are many benefits 


of the LM dictionaryBennani (2019). Such as, firstly, researcher subjectivity is avoided Bennani 


(2019). Only a relevant package for the LM dictionary has to be installed in Python and run a 
small chunk of code. A detailed of instructions are available in the appendix. Ultimately, as this 
dictionary is accessible to the public, reproducing this analysis is straightforward Bennani (2019). 
Numerous studies employ a similar method, using an LM dictionary to tally particular words and 
sentences to quantify the sentiments in central banks communication, as exemplified in works such 
as Schmeling and Wagner (2019) and Hubert and Fabien (2017). 

That is why, we use the same dictionary technique to find out words which can be classified into 
positive and negative words in financial context. We count positive words and negative words for 


each published monetary policy document of State Bank of Pakistan. 


Figure 2: Percentage of Positive and Negative Words 
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Figure 2 shows the total percentage of positive words and negative words. We can clearly see that 
SBP documents contain more negative words indicating the pessimism of SBP. 


We compute the Tone of SBP documents using the below formula: 


T = [PositiveW ords — NegativeW ords|/|PositiveW ords + NegativeW ords| (1) 


where T represent the tone of documents. Range of T is [-1, +1]. The value close to -1 means the 


tone of a document is negative, close to zero mean neutral, and close to +1 means positive. 


Figure 3 shows the increase and decrease in the tone of SBP monetry policy documents. 
Figure 3: Tone of SBP Communication 
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Figure 3 above shows that T does not show any apparent trend through the sample period; therefore, 
it avoids the structural and econometric issues that arise with a trend. The figure 3 also shows that 
change of the tone evolves negatively and positively through time, suggesting continuous evolution 


in the tone of SBP communications. 


3.2. Stock Market Index 


To investigate the influence of the communications of the State Bank of Pakistan (SBP) on the 
Pakistan Stock Market, we analyze daily stock market data. Our focus is on the KSE - 100 index, 
which monitors the daily, weekly, and monthly performance of shares from 100 listed companies. 
Specifically, we examine daily returns within the time frame that coincides with the release of 
SBP documents. Our goal is to evaluate how the tone of SBP documents released on a given day, 
influences the stock market’s performance on the same day. This analysis employs a high-frequency 


method to capture the nuanced relationship between SBP communications and the dynamics of the 


stock market. 


3.3. Control Variables 


To examine the influence of the tone in State Bank of Pakistan (SBP) communications on stock 
prices, accounting for economic and financial conditions, we incorporate various control variables. 
These include data on policy rate, consumer confidence, and economic uncertainty. 

SBP Policy Decision: Policy rate is one of the main instrument used by central banks for 
monetary policy. In order to control for SBP policy rate decision, we use monthly KIBOR rate as 
a proxy. KIBOR rate is calculated monthly. 

Consumer Price Index: Consumer Price Index (CPI) measures the average change in prices 
paid by consumers for a basket of goods and services. It is often used to measure inflation. If the 
inflation is high, it might reduce the purchasing power of consumers, which in return decreases the 
sales for companies. Change in CPI influences the investors expectations about future economic 
growth, which can impact their buying and selling in stock market. We use monthly data of CPI 
because it is measured monthly and yearly. 

Industrial Production Index: The Industrial Production Index (IPI) is one of the important 
factors to gauge the overall health of an economy. Companies in the industrial sector most often 
have a large share in the stock market. Higher IPI indicates better performance and higher profits 
for these companies, aids to higher stock prices. We use monthly IPI data. 

Consumer Confidence Index: Consumer Confidence Index (CCI) measures the overall confi- 
dence of consumers and their pessimism and optimism about overall state of the economy and 
their personal financial conditions. Consumer confidence can significantly impacts the sentiments 
of investors. When consumers are optimistic, investors feel more confident about future financial 
conditions, and in return willing to invest more in stock market, and vice versa. We use monthly 
data of CCI. 

Economic Uncertainty: We use the monthly Economic Policy Uncertainty (EPU) index con- 
structed by Choudhary et al. (2020) in order to control the political instability and economic 


uncertainty in Pakistan. The EPU index is developed using newspapers and articles with respect 


10 


to policy uncertainty. Choudhary et al. (2020) count the number of articles published on the various 
platform using the terms uncertain or uncertainty, economic or economy, and scale the EPU count 
by a measure of the number of articles in the same newspaper and month. Higher EPU index de- 
creases the investors’ confidence. Investors being uncertain about future policies means they might 


be reluctant to invest in stocks and vice versa. 


The sources of our data are Word Bank data base, SBP official website, IMF Data Base, Stock 
Market data base, and Pakistan Bureau of Statistics. Table 1 below shows the summary statistics 
of all the variables. 


Table 1: Summary statistics of variables 


Variable Obs Mean _ Std. Dev. Min Max 


Stock Returns 56 -0.001 0.014 -0.068 0.032 
Sentiments (Tone) 56 = -0.224 0.279 -0.666 0.999 
Policy Rate 56 11.10 5.60 5.75 22 
Consumer Confidence Index 56 41.90 6.70 26.20 55.9 
Consumer Price Index 56 0.130 0.099 0.029 0.364 
EPU Index 56 128.4 62.4 28.1 328.3 
Industrial Production Index 56 -2.80 12.5 -41.1 26.8 


KIBOR Rate 56 11.6 5.6 6 23.6 


4 Methodology 


In order to check the unit root in our data, to find that whether our data is stationary or not, we use 
the Augmented Dickey-Fuller (ADF) test. We find that the null hypothesis cannot be rejected for 
consumer price index, EPU index, and KIBOR rate. Test statistic of all these variables are greater 
than the critical values at all the levels of significance (1%, 5%, and 10%) as well as their p-values 
are greater than the common significant level of 0.05. Test statistics of consumer confidence index 
is less than critical value at 10% significant level but not than 5% and 1% significant levels. But 
its p-value is greater than the common significant level of 0.05. There is some indication that the 


consumer confidence index might be stationary, but it’s not conclusive. Similarly, The test statistic 
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of industrial production index, which is less than the critical values at the 5% and 10% significance 
levels (but not the 1% level). This means that we can reject the null hypothesis at the 5% and 
10% significance levels, but not at the 1% level. In other words, there is some evidence to suggest 
that the industrial production index is stationary, but the evidence is not conclusive. Table 2 below 


shows all the summary of ADF test. 


Table 2: Results of ADF test 


Variable t-Statistic Prob 
Stock Returns -5.44 0 
Sentiments (Tone) -5.35 0 
KIBOR Rate -0.94 0.76 
Consumer Confidence Index -1.98 0.29 
Consumer Price Index -0.63 0.85 
EPU Index -2.69 0.08 


Industrial Production Index -3.24 0.02 


Since, the data is not completely stationary but composed of both stationary and non stationary 
variables. Here, the OLS fails to give accurate results. There is a time series component in our 
data, so there must be the effects of lagged values of the variables. To incorporate such data in our 
econometrics setup, we used the Autoregressive Distributed Lagged (ARDL) model. This model 
incorporate lagged values of the dependent variable and possibly the independent variables as well. 
This accounts for the autocorrelation present in time series data, where current values are often 
correlated with past values. The ARDL model allows for the estimation of both short-term and 
long-term effects. The long-term relationship is captured by the coefficients associated with the 
lagged variables, indicating the equilibrium relationship between the variables Jmaii (2011). 

The most crucial step after choosing the ARDL model is the number of optimal lags each variable 
will have. To find the optimial number of lags we use the Akaike Information Criterion (AIC) using 


E-Views. Rather than concentrating only on the correlation between the time series and its lag 
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values, AIC takes into account both the quality of fit and the complexity of the model. This makes 
it a superior method Ahmad (2023). Appendix has the output of AIC. 

Figure 4 in the appendix showcases the 20 models with the most favorable AIC values. Each 
line represents a model, with the y-axis displaying its AIC score and the x-axis differentiating the 
models. By analyzing the graph, we can determine the model that provides the optimal fit for the 
data set. In our case, Model3809 emerged as the superior choice, boasting the lowest AIC score on 
the graph, and gives us optimal number of lags for each specific variable which are 4, 3, 3, 4, 2, 3, 


1, also shown in the figure 4. 


5 Econometrics Setup 


We explore in what ways does a change in the sentiments of SBP communications impact stock 
returns. To achieve this, we have to calculate the stock price returns around the day on which SBP 
monetary policy documents being published. The main motivation behind this is that any price 
fluctuation in this specific time frame is probably due to change in the tone of the SBP monetary 
policy documents. 

The State Bank of Pakistan (SBP) encompasses policy targets that extend beyond conventional 
considerations such as price stability and the output gap to include financial market stability. 
The release of SBP documents is perceived not just as a communication of policy stance but also 
as an indication of the State Bank’s intent to manage market expectations and guide reactions 
during challenging situations. For instance, a positive change in the tone of these documents 
might signify the SBP’s response to an optimism in the stock market, anticipating government 
intervention. Consequently, following a negative shock, the stock market can respond negatively to 
SBP documents. This underscores the role of SBP documents as a policy tool influencing market 
reactions. To address potential endogeneity issues, we incorporate control variables that could 
introduce omitted variable bias. 

To check the instant affect of SBP communications on stock return at month t we calculate the 


daily stock price returns using daily closing price preceding the document and the day on which 
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the document is published. 


Returns(t) = Bo + @- Tone(t) + 2 GB, - X;(t) + e(t) (2) 


Returns(t) shows the stock price return where t showing the publishing day of the SBP monetary 
policy document, {o is a constant, ? measures the effect of the change in the tone. X(t) is the array 
of control variables with coefficient 8;. The error term ¢(t) contains financial or economic factor 


affecting the stock returns which have not be taken as control variables. 


6 Results 


In this section, we explain that there is a statistically significant relation between the sentiments 
conveyed in the monetary policy documents of the State Bank of Pakistan and stock prices in 
Pakistan more specifically KSE-100 index returns. To provide evidence that sentiments of SBP 
monetary policy documents hold further information for stock market fluctuations beyond funda- 
mental economical conditions. We estimate equation No. 2 twice: without control variables and 
with control variables. Without control variables results are shown in the appendix. The table 3 
below shows the calculated results of equation No. 2 for the time span from 2016MO01 to 2024M01. 
Below Table explains that fluctuation in the sentiments of SBP monetary policy documents has 
a statistically significant impact on stock prices. Hence, positive (negative) change of the tone 
is associated with higher (lower) stock prices in KSE-100. The coefficient of tone is significantly 
positive which is 0.03. In economic terminology, one unit increase (decrease) in tone is associated 
with an increase of approximately 0.03 units in stock market returns. when we add control variables, 
the affect of sentiments on stock returns stays the same. More interestingly, with adding lags, the 
results stays the same as well. Results of base models are in appendix. About control variables, the 
results shows that consumer confidence index third lag is statistically significant. A unit increase 
(decrease) in consumer confidence index is connected with an increase (decrease) 0.002 units in 
stock prices returns. Similarly, the third lag of consumer price index is significant with a coefficient 


0.42 indicating that consumer price index has a positive impact on stock returns. The lags of 
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Table 3: Tone of SBP and Stock Market Returns 


Variable Coefficient Variable Coefficient 


Tone 0.030*** KIBOR. Rate(-2) 0.009 
0.007 0.004 
Tone(-1) -0.010 KIBOR_Rate(-3) -0.010*** 
0.007 0.002 
CCI -0.003 CPI 0.068 
0.005 0.092 
CCIE1) -0.004 CPI(-1) -0.109 
0.005 0.105 
CCl) -0.002 CPI(-2) -0.192 
0.006 0.117 
CCI(-3) 0.002*** CPI(-3) 0.428*** 
0.006 0.102 
IPI -0.003 EPU_Index 6.60E-05 
0.001 6.15E-05 
IPI(-1) 0.009*** EPU_Index(-1) -0.002*** 
0.002 5.89E-05 
IPI(-2) -0.006 EPU_Index(-2) 0.001 
0.002 6.59E-05 
KIBOR_Rate 0.002 EPU_Index(-3) 0.002 
0.002 6.56E-05 
KIBOR.Rate(-1) -0.0013 EPU_Index(-4) -6.19E-05 
0.003 4.91E-05 
R-squared 0.817673 F - Statistic 4.312 
Adjusted R-squared 0.628054 Prob (F-Statistic) 0.00 


* ** *AK denote significance at the 10%, 5% level, and 1% level, respectively. Standard errors 
between brackets. 


15 


EPU Index and KIBOR rate are also statistically significant with negative coefficients. This result 
indicates that an increase in either EPU Index or KIBOR rate cause a decrease in stock prices 
returns. Significance of lag variables indicate that there is not an immediate but delayed affect of 


control variables on stock market returns. 


7 Extension 


In this section, we suggest additional extension. We test the constant impact of SBP tone on stock 
returns. Results shows that there is no constant impact of SBP tone on stock market returns and 


the impact of tone vanishes day after the monetary policy documents being published. 


7.1 The Constant Effect of Tone of SBP Communication 


We look into the effect of SBP communication on stock prices days after SBP monetary policy 
documents being published, publicly. We compute the stock prices over n (number) of days, starting 
with the publishing day of monetary policy document and denote them as r,,. For instance, when 
n = 2, rp indicates the stock prices return on one day after the monetary policy documents being 


published. This estimation process have the following equation. 


Tn(t) = Bo + On + Tonen(t) + Bin S> Xin(t) + én(t) (3) 


i=1 
Tn is the cumulative stock returns over n days (with n = 2, 3), after the documents of monetary 
policy published at date t. Rest of the variables are same as equation 2. Table 4 below shows the 
results for the period 2016MO1 to 2024M01. 

Table 4 shows the results of impact of the tone on cumulative stock prices. It shows that tone has 
no significant impact on stock prices during the later time window i.e. when n = 2, 3. Hence, 
these results suggest that tone of SBP does not have a persistent effect on stock prices a day after 
the monetary policy documents is published. To save the space, we add the complete results of 


cumulative stock prices and tone in the appendix. 
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Table 4: SBP Tone and Preceding Stock Prices 


Without control variables With control variables 
Day Bo Tone,(t) R? Obs. | Bo Tone, (t) R? ~~ Obs. 
n=2  -0.001 0.043 0.077 56 -0.016 0.019 0.751 56 
[0.002] [0.008] [0.062] [0.010] 
n=3 0.001 0.016 0.196 56 -0.056 0.003 0.725 56 
[0.002] [0.007] [0.083] [0.009] 


8 Robustness 


8.1 Breusch-Pagan-Godfrey test for heteroskedasticity 


Table 5: Heteroskedasticity Test: Breusch-Pagan-Godfrey 


Test Statistic Value 
F-statistic 1.68 
Prob. F(26, 25) 0.09 
Obs*R-squared 33.0 


Prob. Chi-Square(26) 0.15 
Scaled explained SS 12.3 
Prob. Chi-Square(26) 0.98 


Table 5 presents the results of the Breusch-Pagan-Godfrey test for heteroskedasticity in our ARDL 
model. The F-statistic value is 1.683223, with an associated p-value of 0.0986. This indicates 
some evidence for heteroskedasticity at the 10% significance level but not at the 5% level. The 
Obs*R-squared value is 33.09470 with a p-value of 0.1594, which supports the null hypothesis of 
homoskedasticity, indicating no significant evidence of heteroskedasticity. Additionally, the Scaled 
explained SS value is 12.32241 with a p-value of 0.9892, providing very strong evidence for ho- 
moskedasticity. Overall, these test statistics suggest that there is no significant evidence of het- 
eroskedasticity in our ARDL model. This implies that the variance of the residuals is constant 


across observations, ensuring the reliability of our model’s standard errors and test statistics, and 
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thus enhancing the validity of our results. The appendix contains a complete table showing the 


heteroskedasticity test. 


8.2 Ljung-Box Test for Autorrelation 
Table 6: Ljung-Box Q-Test Results Summary 


Lag Q-Statistic P-Value 


al 0.19 0.66 
2 3.45 0.17 
3 5.37 0.14 
4 6.46 0.16 
5 9.88 0.07 
10 14.1 0.16 


24 24.9 0.40 


Above table indicates the outcome of the Ljung-Box Q-test for checking for autocorrelation of the 
residuals of our ARDL model at different lag orders. The table contains three columns: Lag, 
Q-statistic, and p-value Lag is a measure of how long it takes for the time series to return to 
a fixed value after a large shock. The first row of the table represents a particular lag and the 
test statistic (Q-Statistic) and the second row represents the corresponding p-value (P-Value). 
The Q-Statistic measures the extent of autocorrelation in the residuals at each lag. Higher Q- 
statistics suggest a greater degree of autocorrelation. The P-Value indicates the probability that 
the observed autocorrelation could be due to random chance. A low p-value (typically below 0.05) 
would suggest that the autocorrelation is statistically significant. The Ljung-Box Q-test results 
in the table indicate that at most lags, the p-values are above the conventional significance level 
of 0.05. For example, at lag 1, the Q-Statistic is 0.19 with a p-value of 0.66, and at lag 24, the 
Q-Statistic is 24.9 with a p-value of 0.40. These high p-values suggest that there is no significant 


autocorrelation in the residuals at these lags. The complete result of the Ljung-Box test is in the 
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appendix. The lack of significant autocorrelation implies that the residuals are essentially random 
and not systematically patterned. This indicates that our ARDL model has effectively captured 


the underlying data patterns and dynamics, leading to reliable and unbiased parameter estimates. 


9 Policy Recommendation 


To create more stable and predictable financial environment, the SBP should refine its communica- 
tion strategies with more clear language, more positive words, consistency, and positive reinforce- 
ment in its communication regarding monetary policy. Empirical evidence from our study indicates 
that optimistic and positive sentiments conveyed in monetary policy communications, significantly, 
give boost to the investors confidence which create more resilient stock market. Therefore, it is 
recommended that the SBP adopt a proactive communication policy that includes regular updates 
on economic conditions, transparent explanations of policy decisions, and forward guidance that is 
both clear and cautiously optimistic. Additionally, leveraging advanced sentiment analysis tools to 
pre-evaluate the tone of these communications can help ensure that the intended positive sentiment 
is effectively conveyed. By aligning the tone of its messages with strategic economic goals, the SBP 
can enhance market predictability, mitigate unnecessary volatility, and support sustained economic 


growth. 


10 Conclusion 


Using textual, unstructured, and unsupervised data to measure and model the financial dynamics 
has been very popular since last decade. Our research intends to make contribution to this research 
by checking the impact of SBP communication on stock market of Pakistan. We first compute the 
tone of SBP monetary policy announcements by a computational linguistics approach using LM 
dictionary developed by Loughran and McDonald (2011). In the second phase, we assess the effect 
of SBP tone on the stock market using a high frequency technique. Results show that improvements 


in tone have a positive impact on stock prices in Pakistan, particularly in the Karachi Stock Market. 
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Tone has a substantial impact on stock price, and this effect is resistant to a number of control 
variables. The results of our study demonstrate that SBP communication influences stock price and 
is important as a tool for policy to influence market expectations. Hence, if Pakistan goes towards 
flexible regime change and more financial neutrality, transparent communication, might have many 


advantages to upgrade the impact of State Bank of Pakistan’s monetary policy. 
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Appendix 


The Google Colab notebook in the link contains all the Python code necessary to compute the tone 
of SBP monetary policy documents. This code provides a step-by-step explanation and performs 
various tasks, including: 


1. PDF to Text Conversion: Converts PDF documents to .txt files. 


2. Text Preprocessing: Removes full stops, commas, quotations, dates, days, months, years, 
hashtags, graphs, and tables from the documents. 


3. Sentiment Analysis: 


(a) Extracts positive, negative, and neutral words from the monetary policy documents. 


(b) Computes subjectivity and polarity scores. 


4. Output: Saves the results in an Excel file, which includes the number of positive words, 
negative words, neutral words, subjectivity, and polarity in the monetary policy documents. 


https: //colab.research.google.com/drive/1cT6hBM57ZHoOqvdl0gndylAdvUa90DeY?usp=sharing 


Figure 4: Optimal Lags Criteria 
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The figure 4 above presents the AIC values of the twenty best models estimated from the ARDL 
approach. On the x-axis, the models are shown starting with Model3809 to Model3310 while the 
y-axis shows the corresponding AIC values. The AIC values are found to be approximately -6.36 to 
-6.29, are based on the goodness of fit of the model with lower values considered as better models. 
Model3809, having the lowest AIC value, is the best model among the top 20 listed models. This 
model gives optimal lags shown. We incorporate this specific number of lags in our ARDL model. 
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Table 7: Simple OLS Result 


Variable Coefficient Std. Error t-Statistic Prob. 
Cc 0.003 0.002 1.344 0.184 
Tone 0.02** 0.006 2.656 0.010 
R-squared 0.115 F-statistic 7.055 
Adjusted R-squared 0.099 S.D. dependent var 0.014 


The table 7 above shows the result of OLS model, which has only two variables, tone of SBP 
monetary policy documents as independent variable and stock market returns. The result indicate 
that the change in tone has a statistically significant impact on stock prices, even in the absence of 
lags and control variables. 


Table 8: OLS With Lagged Values of Dependent Variable 


Dependent Variable: Returns 


Variable Coefficient Std. Error t-Statistic Prob. 
Cc 0.002 0.002 1.215 0.230 
Tone 0.02** 0.006 2.605 0.012 
Returns(-1) 0.375** 0.139 2.686 0.010 
Returns(-2) -0.225 0.149 -1.505 0.139 
Returns(-3) -0.095 0.148 -0.643 0.523 
Returns(-4) 0.054 0.134 0.407 0.685 
R-squared 0.274 F-statistic 3.488 


Adjusted R-squared 0.196 Prob(F-statistic) 0.009 
* ** ** denote significance at the 10%, 5% level, and 1% level, respectively. 


Table 8 shows the simple OLS model with only two variables, stock market returns as dependent 
variable and tone of SBP monetary policy documents as an independent variable alongside four 
lagged values of dependent variable return. Even in the presence of lagged values of returns, the 
change in the tone of SBP communication has a statistically significant impact on stock market 
returns. 
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Table 9: OLS With Lagged Values of Dependent Variable and Control Variable 


Dependent Variable: Returns 


Variable Coefficient Std. Error t-Statistic Prob. 
Cc -0.033 0.029 -1.156 0.254 
Tone 0.02** 0.006 2.831 0.007 
IPI 0.002 0.002 1.130 0.276 
Kibor_Rate 0.002 0.001 0.001 0.998 
CCI 0.001 0.001 0.328 0.732 
CPI 0.048 0.062 0.785 0.433 
EPU -5.33E-05 6.01E-05 -0.887 0.379 
Returns(-1) 0.152 0.203 0.780 0.428 
Returns(-2) -0.381 0.181 -2.099 0.042 
Returns(-3) -0.194 0.154 -1.258 0.215 
Returns(-4) -0.063 0.154 -0.411 0.682 
R-squared 0.372 F-statistic 2.436 


Adjusted R-squared 0.219 Prob(F-statistic) 0.021 
* *K *** denote significance at the 10%, 5% level, and 1% level, respectively. 


Table above shows the results of OLS with tone being independent variable along with other control 
variables and lagged values of dependent variable. The results indicates that the tone of SBP 
monetary policy documents has a statistically significant impact on the stock market returns. This 
impact is even stronger than the impact in previous models. The interesting fact is that the tone 
of SBP communication has statistically significant on stock market returns across all the models. 
After these three base models, we move towards our main ARDL model which is explained in section 
6. 


Table 10: Without Control Variables when n=2 


Variable Coefficient Std. Error t-Statistic Prob. 
Returns_2(-1) -0.056 0.137 -0.414 0.680 
Returns_2(-2) -0.273 0.138 -1.972 0.054 
TONE -0.0103 0.008 -1.280 0.205 
Cc 0.001 0.002 0.065 0.947 
R-squared 0.077 Mean dependent var -0.001 
Adjusted R-squared 0.021 S.D. dependent var 0.017 
F-statistic 1.396 Durbin-Watson stat 2.048 


Table 10 above is the complete output when we take n=2 (stock returns one day after the documents 
are published publicly) with tone as an independent variable and no control variables. 
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Table 11: With Control Variables when n=2 


Variable Coefficient Std. Error t-Statistic Prob. 


Returns_2(-1) -0.432** 0.166 -2.601 0.015 
Returns_2(-2) -0.306 0.161 -1.894 0.070 
Returns_2(-3) -0.420** 0.170 -2.469 0.021 
TONE 0.019 0.010 1.782 0.087 
TONE(-1) -0.014 0.010 -1.482 0.151 
CCI 0.001 0.001 1.217 0.235 
CCI(-1) -0.003** 0.001 -3.389 0.002 
CCI(-2) 0.004 0.001 0.548 0.588 
CCI(-3) 0.002 0.001 0.222 0.826 
CCI(-4) 0.001 0.001 2.004 0.056 
CPI 0.149 0.136 1.093 0.284 
CPI(-1) -0.130 0.157 -0.827 0.416 
CPI(-2) -0.329 0.181 -1.812 0.082 
CPI(-3) 0.118 0.153 0.776 0.445 
CPI(-4) 0.580** 0.147 3.945 0.001 
EPU 0.001 0.001 1.309 0.202 
EPU(-1) -0.001 0.001 -0.473 0.640 
EPU(-2) -0.001 0.001 -0.669 0.509 
EPU(-3) 0.002** 0.001 2.742 0.011 
IPI 0.001 0.002 0.304 0.763 
IPI(-1) 0.003 0.002 1.332 0.195 
IPI(-2) -0.003 0.002 -1.287 0.210 
Kibor_Rate -0.003 0.002 -1.050 0.304 
Kibor_Rate(-1) 0.001 0.005 0.342 0.734 
Kibor_Rate(-2) 0.001 0.005 0.267 0.791 
Kibor_Rate(-3) 0.003 0.005 0.753 0.458 
Kibor_Rate(-4) -0.012** 0.003 -3.293 0.003 
C -0.016 0.062 -0.267 0.791 
R-squared 0.751 Mean dependent var -0.001 

Adjusted R-squared 0.471 S.D. dependent var 0.017 

F-statistic 2.684 Durbin-Watson stat 2.210 


* ** ** denote significance at the 10%, 5% level, and 1% level, respectively. 


Table 11 above is the complete output when we take n=2 (stock returns one day after the documents 
are published publicly) with tone as an independent variable along with control variables. 
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Table 12: Without Control Variables when n=3 


Variable Coefficient Std. Error t-Statistic Prob.* 
Returns_3(-1) 0.162 0.132 1.066 0.249 
Tone 0.016** 0.007 2.397 0.020 
Tone(-1) -0.012 0.007 -1.684 0.098 
Tone(-2) -0.012 0.007 -1.842 0.078 
C 0.0140 0.002 5.029 0.000 
R-squared 0.196 Mean dependent var 0.003 
Adjusted R-squared 0.131 S.D. dependent var 0.014 
F-statistic 2.998 Durbin-Watson stat 2.088 


* ** **K denote significance at the 10%, 5% level, and 1% level, respectively. 


Table 12 above is the complete output when we take n=3 (stock returns one day after the documents 
are published publicly) with tone as an independent variable and no control variables. 
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Table 13: With Control Variables when n=3 


Variable Coefficient Std. Error t-Statistic Prob.* 
Returns_3(-1) -0.131 0.206 -0.639 0.528 
Returns_3(-2) 0.229 0.185 1.231 0.230 
Returns_3(-3) -0.309 0.172 -1.791 0.080 
Tone 0.003 0.009 0.331 0.742 
Tone(-1) -0.005 0.008 -0.676 0.499 
Tone(-2) -0.018 0.010 -1.868 0.073 
Tone(-3) 0.011 0.008 1.340 0.179 
CCI -0.001 0.001 -0.141 0.888 
CCI(-1) 0.001 0.001 1.508 0.144 
CCI(-2) 0.001 0.001 1.112 0.265 
CCI(-3) -0.001 0.001 -2.155 0.041 
CCI(-4) 0.001 0.001 1.079 0.281 
CPI 0.020 0.142 0.145 0.888 
CPI(-1) 0.106 0.168 0.629 0.529 
CPI(-2) 0.059 0.127 0.461 0.645 
CPI(-3) -0.130** 0.153 -0.852 0.398 
CPI(-4) 0.231** 0.116 1.989 0.047 
EPU 0.001 8.35E-05 1.463 0.144 
IPI -6.04E-05 0.001 -0.290 0.772 
IPI(-1) 0.002** 0.001 2.265 0.032 
IPI(-2) -3.59E-05 0.001 -0.143 0.886 
IPI(-3) -0.001 0.001 -0.636 0.528 
Kibor_Rate -0.003 0.002 -1.366 0.171 
Kibor_Rate(-1) 0.004 0.002 1.940 0.052 
Kibor_Rate(-2) 0.001 0.004 0.558 0.580 
Kibor_Rate(-3) -0.004 0.005 -0.963 0.345 
Kibor_Rate(-4) -0.008*** 0.003 -2.964 0.004 
C -0.056 0.083 -0.674 0.506 
R-squared 0.725 F-statistic 2.354 

Adjusted R-squared 0.417 Prob(F-statistic) 0.018 


* *K **K denote significance at the 10%, 5% level, and 1% level, respectively. 


Table 10 above is the complete output when we take n=3 (stock returns one day after the documents 
are published publicly) with tone as an independent variable along with control variables. 
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